Skip to main content

Corporation Websites Collection

This collection contains an extracted web archive corpus of 0.8+ million corporate websites (from an original list of ~0.98 websites) extracted from the archive.org web archive, covering the period 1996 to early 2017. This corpus was originally created as a collaboration between the Internet Archive and a group at Dartmouth University, but it may be useful to other researchers.

Updated or more detailed information may exist at:

Corpus Statistics

  • approximately 840,000 domains
  • more than 500,000,000 unique URLs
  • more than 1,600 WARC files and 26,000 ARC files
  • more than 3.25 TB compressed

Content

This dataset contains a sample of up to 500 unique text/html URLs per year for given websites. The sample records were selected based on the sort order of the URL strings and extracted and packaged into (W)ARC files. The breakdown of the number of captures per year per domain is available here:

How to Download

This large corpus is split into several hundred distinct "items" on archive.org.

We recommend using the internetarchive python utility (aka, "ia") for bulk downloads. See also:

WARC and ARC downloads can be verified using the unified manifest files at:

Additional manifest and derived information (including CDX files) exist at:


PART OF
Web Data Services
More right-solid
SHOW DETAILS
up-solid down-solid
eye
Title
Date Archived
Creator
Corporation Websites Collection
data
eye 7,813
favorite 0
comment 0
Corporation Websites Collection
data
eye 7,735
favorite 0
comment 0
Corporation Websites Collection
data
eye 6,449
favorite 0
comment 0
Corporation Websites Collection
data
eye 6,192
favorite 0
comment 0
Corporation Websites Collection
data
eye 5,064
favorite 0
comment 0
Corporation Websites Collection
data
eye 4,826
favorite 0
comment 0
Corporation Websites Collection
data
eye 4,602
favorite 0
comment 0
Corporation Websites Collection
data
eye 3,871
favorite 0
comment 0
Corporation Websites Collection
data
eye 3,851
favorite 0
comment 0
Corporation Websites Collection
data
eye 3,613
favorite 0
comment 0
Corporation Websites Collection
data
eye 3,459
favorite 0
comment 0
Corporation Websites Collection
data
eye 3,286
favorite 0
comment 0
Corporation Websites Collection
data
eye 3,285
favorite 0
comment 0
Corporation Websites Collection
data
eye 3,064
favorite 0
comment 0
Corporation Websites Collection
data
eye 2,667
favorite 0
comment 0
Corporation Websites Collection
data
eye 2,540
favorite 0
comment 0
Corporation Websites Collection
data
eye 2,468
favorite 0
comment 0
Corporation Websites Collection
data
eye 2,430
favorite 0
comment 0
Corporation Websites Collection
data
eye 2,406
favorite 0
comment 0
Corporation Websites Collection
data
eye 2,304
favorite 0
comment 0
Corporation Websites Collection
data
eye 2,304
favorite 0
comment 0
Corporation Websites Collection
data
eye 2,258
favorite 0
comment 0
Corporation Websites Collection
data
eye 2,254
favorite 0
comment 0
Corporation Websites Collection
data
eye 2,110
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,954
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,954
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,954
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,941
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,911
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,902
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,888
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,877
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,836
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,826
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,801
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,799
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,747
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,679
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,661
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,613
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,569
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,565
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,533
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,473
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,359
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,294
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,226
favorite 0
comment 0
Corporation Websites Collection
data
eye 1,049
favorite 0
comment 0
Corporation Websites Collection
data
eye 987
favorite 0
comment 0
Corporation Websites Collection
data
eye 987
favorite 0
comment 0
Corporation Websites Collection
data
eye 982
favorite 0
comment 0
Corporation Websites Collection
data
eye 976
favorite 0
comment 0
Corporation Websites Collection
data
eye 967
favorite 0
comment 0
Corporation Websites Collection
data
eye 963
favorite 0
comment 0
Corporation Websites Collection
data
eye 963
favorite 0
comment 0
Corporation Websites Collection
data
eye 963
favorite 0
comment 0
Corporation Websites Collection
data
eye 953
favorite 0
comment 0
Corporation Websites Collection
data
eye 944
favorite 0
comment 0
Corporation Websites Collection
data
eye 939
favorite 0
comment 0
Corporation Websites Collection
data
eye 934
favorite 0
comment 0
Corporation Websites Collection
data
eye 931
favorite 0
comment 0
Corporation Websites Collection
data
eye 923
favorite 0
comment 0
Corporation Websites Collection
data
eye 920
favorite 0
comment 0
Corporation Websites Collection
data
eye 919
favorite 0
comment 0
Corporation Websites Collection
data
eye 913
favorite 0
comment 0
Corporation Websites Collection
data
eye 903
favorite 0
comment 0
Corporation Websites Collection
data
eye 901
favorite 0
comment 0
Corporation Websites Collection
data
eye 900
favorite 0
comment 0
Corporation Websites Collection
data
eye 888
favorite 0
comment 0
Corporation Websites Collection
data
eye 879
favorite 0
comment 0
Corporation Websites Collection
data
eye 876
favorite 0
comment 0
Corporation Websites Collection
data
eye 876
favorite 0
comment 0
Corporation Websites Collection
data
eye 866
favorite 0
comment 0
Corporation Websites Collection
data
eye 860
favorite 0
comment 0
Corporation Websites Collection
data
eye 860
favorite 0
comment 0